Validity of peer grading using Calibrated Peer Review in a guided-inquiry, conceptual physics course
نویسندگان
چکیده
Constructing and evaluating explanations are important science practices, but in large classes it can be difficult to effectively engage students in these practices and provide feedback. Peer review and grading are scalable instructional approaches that address these concerns, but which raise questions about the validity of the peer grading process. Calibrated Peer Review (CPR) is a web-based system that scaffolds peer evaluation through a “calibration” process where students evaluate sample responses and receive feedback on their evaluations before evaluating their peers. Guided by an activity theory framework, we developed, implemented, and evaluated CPR-based tasks in guided-inquiry, conceptual physics courses for future teachers and general education students. The tasks were developed through iterative testing and revision. Effective tasks had specific and directed prompts and evaluation instructions. Using these tasks, over 350 students at three universities constructed explanations or analyzed physical phenomena, and evaluated their peers’work. By independently assessing students’ responses, we evaluated the CPR calibration process and compared students’ peer reviews with expert evaluations. On the tasks analyzed, peer scores were equivalent to our independent evaluations. On a written explanation item included on the final exam, students in the courses using CPR outperformed students in similar courses using traditional writing assignments without a peer evaluation element. Our research demonstrates that CPR can be an effective way to explicitly include the science practices of constructing and evaluating explanations into large classes without placing a significant burden on the instructor.
منابع مشابه
Supporting scientific writing and evaluation in a conceptual physics course with Calibrated Peer Review
Writing tasks are one way students can apply science concepts, yet evaluating students’ writing can be difficult in large classes. With the web-based Calibrated Peer Review* (CPR) system, students submit written work and evaluate each other. Students write a response to a prompt, read and evaluate responses prepared by the curriculum developers, and receive feedback on their evaluations, allowi...
متن کاملThe Effect of Guided Reciprocal Peer Questioning (GRPQ) on Nursing Students' Critical Thinking and Metacognition Skills
Introduction: Fostering critical thinking and Metacognition is one of the most important objectives in nursing education. This study was designed to investigate the effect of guided reciprocal peer questioning on nursing students' critical thinking and Metacognition skills. Methods: In this quasi experimental study, the experiment group included 30 nursing students in their 6th semester in Bi...
متن کاملTeaching through Near-Peer Method in Medical Education: A Systematic Review
Introduction: Peer education is implemented in various curricula. However, there are conflicting reports of its effects. The aim of this study was to review the literature and assess the outcomes of near-peer education for students of medical sciences. Methods: In this systematic review, an online search was carried out to identify articles published from 1995-2015 on assessing the outcomes o...
متن کاملWriting to Learn: An Evaluation of the Calibrated Peer Review™ Program in Two Neuroscience Courses
Although the majority of scientific information is communicated in written form, and peer review is the primary process by which it is validated, undergraduate students may receive little direct training in science writing or peer review. Here, I describe the use of Calibrated Peer Review™ (CPR), a free, web-based writing and peer review program designed to alleviate instructor workload, in two...
متن کاملThe Viewpoints of Alborz University of Medical Sciences’ Faculty Members on Open Peer Review of Journal Articles
Background and Aim: The open peer review process, which is one of the peer-reviewed methods in journals, has been accepted in scientific forums. The aim of this study was to investigate the points of view of university faculty members about the open peer review process of journal articles. Materials and Methods: The study used a descriptive survey. The sample size was calculated using the Coch...
متن کامل